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Description 

SYSTEMS AND METHODS THAT ALTER 
ELECTRONIC DATA BASED ON 
AVAILABILITY OF TIME 

Background of the Invention 
Field of Invention 

[0001] The invention relates to systems and methods for pro- 
cessing data witli a multifunctional device. More specifi- 
cally, the systems and methods of the invention alter the 
data based on an availability of idle time of the multifunc- 
tional device. 
Description of Related Art 

[0002] Conventional multifunctional devices such as digital scan- 
ners and digital copiers process electronic data and then 
send the processed electronic data to a memory prior to 
transmitting the electronic data to another destination. 
For example, after image data has been processed into a 
Joint Photographic Experts Group OPEC) electronic data 



file, the electronic data file can be sent to a memory or 
temporary holding queue prior to the electronic data file 
being sent to an out terminal or receiving device like a 
printer, or prior to the electronic data file being exported 
to a network. Because the electronic data file stored and 
awaiting further action, the process creates "idle time" be- 
fore the electronic data file is transmitted to the output 
terminal or requested by the receiving device for either 
the printing or exporting. In some instances, the elec- 
tronic data file is either waiting for a previous print job to 
finish printing or waiting in the queue because of a back- 
log in the network. The data file can also be stalled in the 
queue due to a higher priority Job that takes precedent. 
Thus, the state of the output terminal or receiving device, 
a higher level interrupt created at the output terminal or 
receiving device for a different job or any other external 
delay in handling the current job can cause idle time to 
exist in the multifunctional device. 
[0003] Some multifunctional devices allow a user to use a "store 
and call" feature whereby a job is scanned or copied and 
then stored in a memory so that the electronic data can be 
recalled at a later time. Furthermore, some multifunctional 
devices allow a user to scan electronic data to a mailbox 



memory so that the user can send the electronic data over 
a network at a later time. Distributed scanning of images 
is also possible in some multifunctional devices whereby 
multiple documents are scanned to create an electronic 
data file, and sent to a central memory device prior to the 
electronic data being used for some other purpose. In 
many instances, these functions create the idle time as 
discussed above. However, conventional multifunctional 
devices do not utilize the idle time to further process the 
electronic data stored in the memory or in a queue in or- 
der to alter the electronic data so that the multifunctional 
device can increase productivity or anticipate additional 

user needs. 
Summary of the Invention 

[0004] Accordingly, to satisfy the continuing need to improve 

quality, performance and the efficiency of existing multi- 
functional devices, the "idle time" of a multifunctional de- 
vice according to the invention is utilized to perform addi- 
tional processing to alter the electronic data to satisfy 
user needs. For example, processing can be performed 
during the idle time to improve image quality and increase 
productivity by recompressing the electronic data based 
on additional requirements of the user. In some situa- 



tions, recompressing electronic data into certain formats 
can be time consuming. Tlie idle time in conventional 
multifunctional devices is not used to perform alterations 
on an electronic data stored in memory. Thus, the inven- 
tion improves efficiency of the multifunctional device by 
taking advantage of the idle time to further alter an elec- 
tronic data file. The invention can alter the electronic data 
file during the idle time by performing, for example, 
2-pass image processing and additional image enhance- 
ments like Auto Image Enhancement (AIE), Auto Image 
Quality (AIQ) processing applications, applications like 
Mixed Raster Content Generation that reformat com- 
pressed documents to achieve smaller document size and 
OCR Optical Character Recognition processing. Further- 
more, the alterations during the idle time could generate 
summary pages that can be attached to a Job or extract 
any other metadata and send it along with the electronic 
data file for improved printing performance. 
[0005] In accordance with the systems and methods of the inven- 
tion, a multifunctional device can include an input termi- 
nal that inputs electronic data. The electronic data is 
stored in a memory, and then the stored electronic data is 
altered during idle time of the multifunctional device. Af- 



ter the electronic data is stored in tlie memory, a con- 
troller can control the electronic data to be altered by a 
processor during the idle time to improve the quality of 
the data or to perform any number of tasks. 

[0006] In various exemplary embodiments according to the sys- 
tems and methods of the invention, a multifunctional de- 
vice can include a second controller that controls the elec- 
tronic data to be altered by second processor, for exam- 
ple, after the image has been initially converted to elec- 
tronic data from an image, but prior to the electronic data 
being stored in the memory. The second processor alters 
the electronic data using minimal requirements so that 
the data can still be transmitted to a receiving device or 
an output terminal, such as a printer, or exported to a 
network even if no further alterations to the electronic 
data is performed. 

[0007] In various exemplary embodiments according to the sys- 
tems and methods of the invention, a multifunctional de- 
vice can also include a third controller that controls a third 
processor to alter the electronic data after the electronic 
data has been requested by the output device but prior to 
the data being transmitted to the receiving device, output 
terminal or a network. 



Brief Description of the Drawings 

[0008] Various exemplary embodiments of the systems and 

methods according to this invention will be described in 
detail, with reference to the following figures, wherein: 

[0009] Fig. 1 is an exemplary diagram illustrating system compo- 
nents of a multifunctional device; 

[0010] Fig. 2 is an exemplary block diagram illustrating the cir- 
cuitry for the multifunctional device in accordance with 
the invention; 

[0011] Fig. 3 is an exemplary block diagram illustrating the alter- 
ation circuit used in the multifunctional device in Fig. 2 in 
accordance with the invention; 

[0012] Fig. 4 is an exemplary block diagram illustrating the pro- 
cessor used in the multifunctional device in Fig. 2 in ac- 
cordance with the invention; and 

[0013] Fig. 5 is an exemplary flowchart of a method of process- 
ing used by the multifunctional device in accordance with 

the invention. 
Detailed Description of Exemplary Embodiments 

[0014] The invention relates generally to systems and methods 
for utilizing idle time of a multifunctional device to alter 
electronic data according to user requirements. For rea- 



sons of convenience, the embodiments of tlie invention 
will be discussed using a digital scanner as the multifunc- 
tional device. However, it should be appreciated by one 
skilled in the art that the systems and methods of the in- 
vention can be used with any multifunctional device that 
creates idle time without departing from the sprit and 
scope of the invention. 
[0015] Fig. 1 is an exemplary diagram illustrating system compo- 
nents of a digital scanner as the multifunctional device. As 
shown in Fig. 1, components of a scanning unit 20 of a 
digital scanner 30 include a light source 21 that is used to 
illuminate a document 22 prior to scanning. In a platen- 
type scanning situation, the document 22 usually rests 
upon a glass platen 24, which supports the document 22 
for scanning purposes. The document may be placed in 
the glass platen 24 by an operator. Alternatively, the 
scanning unit 20 may include a feeder or document han- 
dler 29, which places the document on the glass 24. An- 
other example of a feeder is shown in U.S. Patent No. 
5,430,536 which is hereby incorporated by reference in its 
entirety. 

[0016] On top of the glass platen 24 and the document 22, a 
backdrop portion (or platen cover) 26 is placed so as to 



prevent stray light from leaving the scanning area and to 
provide an acceptable background for distinguishing an 
input document. The backdrop portion 26 is part of the 
document handler 29 and is the surface or surfaces that 
can be scanned by an image-sensing unit 28 when the 
document 22 is or not present in the scanning station. 
When operating the scanning unit 20, the light source 21 
illuminates the document 22, and then light reflected 
from the document 22 passes through a lens subsystem 
(not shown) so that the reflected light impinges upon the 
image sensing unit 28. The image sensing unit 28 can be 
any type of electronic sensor including a charge coupled 
device (CCD) array or a full width array. Examples of full 
width arrays that can be used in the image sensing unit 
28 are disclosed in U.S. Patent Nos. 5,473,513; 
5,748,344; 5,552,828; 5,691,760; 5,031,032; 5,545,913; 
and 5,604,362, which are hereby incorporated by refer- 
ence in their entirety. 
[0017] Fjg, 2 is an exemplary block diagram illustrating the cir- 
cuitry for the digital scanner 30 in accordance with the in- 
vention. The digital scanner 30 is coupled to an input ter- 
minal 50 by way of an interface 40. An example of a suit- 
able scanner interface is a SCSI interface. Examples of the 



input terminal 50 include a personal computer, a com- 
puter terminal and a remote computer unit. The input ter- 
minal 50 includes and/or has access to a memory 52. The 
input terminal 50 is preferably adapted to communicate 
with a network 54, and to communicate with the Internet 
either directly or through the network 54. The digital 
scanner 30 can be coupled to at least output terminal 60 
such as a printing system. 
[0018] In the digital scanner 30, a computing unit 110, such as a 
microprocessor, can be coupled to the interface 40, mem- 
ory 100 and a processor 200 by way of the bus 95 and a 
bus bridge 120. The computing unit 110 can be coupled 
to a flash memory 130, static RAM 140 and a display 150. 
The computing unit 110 is also connected to the proces- 
sor 200 and the scanning unit 20 shown in Fig. 1 byway 
of the bus 95. 

[0019] The processor 200 in the digital scanner 30 can include a 
processing circuit 70 and a controller 90. In the illustrated 
embodiment, the processing circuit 70 and the controller 
90 are implemented with general purpose processors. 
However, it will be appreciated by those skilled in the art 
that the processing circuit 70 and the controller 90 can be 
implemented using a single special purpose integrated 



circuit (e.g., ASIC) liaving a main or central processor sec- 
tion for overall, system-level control, and separate sec- 
tions dedicated to performing various different specific 
computations, functions and other processes under con- 
trol of the central processor section. The processing cir- 
cuit 70 and the controller 90 can be a plurality of separate 
dedicated or programmable integrated or other electronic 
circuits or devices (e.g., hardwired electronic or logic cir- 
cuits such as discrete element circuits, or programmable 
logic devices such as PLDs, PLAs, PALs or the like). The 
processing circuit 70 and the controller 90 can be suitably 
programmed for use with a general purpose computer, 
e.g., a microprocessor, microcontroller or other processor 
device (CPU or MPU), either alone or in conjunction with 
one or more peripheral (e.g., integrated circuit) data and 
signal processing devices. In general, any device or as- 
sembly of devices on which a finite state machine capable 
of implementing the procedures described herein can be 
used as the processing circuit 70 and the controller 90. A 
distributed processing architecture can be used for maxi- 
mum data/signal processing capability and speed. 
[0020] When operated, the scanning unit 20 scans an image (or 
object) and converts analog signals representative of the 



image received by tlie image sensing unit 28 into elec- 
tronic signals or electronic data. The controller 90 con- 
trols the electronic data so that the processor 200 re- 
ceives the digital image via link 96, registers the image, 
and executes a signal correction to enhance the electronic 
signals. As the processor 200 continuously processes the 
electronic data, a buffer 75 can temporarily store the 
electronic data outputted by the processor 200. After the 
entire image or a sufficient part of the image has been 
processed by the processor 200, the electronic data can 
be controlled by the controller 90 so that the electronic 
data is stored in the memory 100 via the link 98 and the 
bus 95 without any further processing (such as compres- 
sion) to await further action. This action can create "idle 
time," for example, where a lag in time exists before the 
scanned data is either marked for printing or transferred 
over a network. In this instance, the electronic data is 
stored in the memory 100 before the next event occurs. 
[0021] Alternatively, the controller 90 can control the processor 
200 to transmit the electronic data, for example, to an al- 
teration circuit 300 through the buffer 75 and link 91, or 
through link 93. Fig. 3 is an exemplary block diagram the 
alteration circuit 300 used in the multifunctional device in 



Fig. 2 in accordance with tlie invention. Tlie alteration cir- 
cuit 300 can include circuits 301-311 that perform elec- 
tronic data alterations like a metadata extraction circuit 
301, a sharpness circuit 302, a compression circuit 303, a 
reformatting circuit 304, a contrast circuit 305, an Auto 
Image Enhancement (AIE) circuit 306, an exposure circuit 
307, an Auto Image Quality (AIQ) circuit 308, a Mixed 
Raster Content (MRC) circuit 309, an optional circuit for 
detecting additional properties of the image, for example 
the originating source, 310 and/or an Optical Character 
Recognition (OCR) circuit 311. 
[0022] It should be appreciated by one skilled in the art that any 
number of data enhancement, data reorganization or data 
reformatting circuits may be used for the idle time pro- 
cessing. Moreover, any process that alters the structure of 
the electronic data stored in the memory 100 may be per- 
formed by the processor 200 during the idle time without 
departing from the spirit and scope of the invention. Fur- 
thermore, the circuits shown in the alteration circuit 300 
in Fig. 3 can include any circuit or combination of circuits 
that alter the electronic data stored in the memory 100 of 
the multifunctional device of the invention. For example, 
the compression circuit 303 can include the International 



Telecommunications Union (ITU) G3/C4 and Joint Photo- 
graphic Experts Group OPEC). However, other data com- 
pression units may be substituted for ITU G3/G4 and 
JPEG. 

[0023] The electronic data can be altered using the circuits 

301-311 described above by using, for example, a mini- 
mal buffering method for optimizing encoding tables in 
JPEG compression as disclosed in U.S. Patent No. 
6,081,211. The sharpness of the data can be altered by 
the reproduction process of an electronically encoded 
natural scene image as disclosed in U.S. Patent No. 
5363,209. The contrast of image data can be altered by 
deriving a relevant histogram of the image data from a 
selected subset of local histograms representing regions 
of the image as disclosed in U.S. Patent No. 5,581,370, or 
by the method whereby the image data is converted from 
an original set of color coordinates to an expression 
where on term has a relationship to overall image density 
as disclosed in U.S. Patent No. 5,450,502. The data can be 
altered by the image-dependent color saturation correc- 
tion method in natural scene images in electronic docu- 
ments as disclosed in U.S. Patent No. 5,450,217. Finally, 
an exposure in the reproduction of an electronically en- 



coded natural scene image can be altered as disclosed in 
U.S. Patent No. 5,414,538. All of the above cited refer- 
ences disclose examples of altering the electronic data by 
the circuits 301-311 that can be used within the spirit and 
scope of the invention and are hereby incorporated by 
reference in their entirety. 
[0024] Fig. 4 is an exemplary block diagram the processor 200 
used in the multifunctional device in Fig. 2 in accordance 
with the invention. As shown in Fig. 4, the processor 200 
includes the processing circuit 70 and the controller 90. 
The processing circuit 70 may include a first processor 
72, an second processor 73 and a third processor 74. The 
second processor 73 may be configured to perform a 
minimal set of image processing or compression to the 
electronic data after the image or object is first scanned, 
but prior to storing the electronic data into the memory 
100. The second processor 73 can also process the elec- 
tronic data so that the electronic data is scanned and pro- 
cessed to include basic image processing functions and 
any straightforward compression via the compression cir- 
cuit 303, i.e., JPEG for color documents and G4 for black 
and white documents. By pre-processing the electronic 
data with the second processor 73, any minimal require- 



ments are satisfied to transmit tlie electronic data to an- 
other destination in tlie event tliat no furtlier alterations 
are performed because, for example, no idle time exists. 
[0025] The processor 200 can also include a first processor 72 
that can be used when it is determined that idle time ex- 
ists. In this situation, the controller 90 controls the stored 
electronic data to be sent from the memory 100 to an al- 
teration circuit 300 for additional alterations such as 
2-pass processing and/or the additional alterations dis- 
cussed above like AIE and AIQ for improved image en- 
hancement and quality. The controller 90 can also control 
the electronic data to be sent from the memory 100 to a 
reformatting circuit 304 for reformatting the electronic 
data into a Mixed Raster Content (MRC) model. The con- 
troller 90 can also control the electronic data to be sent 
from the memory 100 to the reformatting circuit 304 to 
generate a summary page, and/or generate thumbnails 
for a print job as a summary page, and attach the sum- 
mary page to a print job, or to the metadata extraction 
circuit 301 to extract any other metadata so that the 
metadata can be sent along with the electronic data for 
improved printing. A first controller 92 within the proces- 
sor 200 can monitor the electronic data stored in the 



memory 100 and determine whether any idle time exists 
so that further alterations can be performed during the 
idle time. In various exemplary embodiments according to 
the invention, a user can manually instruct the first con- 
troller 92 to alter an electronic data file if it is determined 
that an appropriate amount of idle time exists. Further- 
more, the first controller 92 can be configured to auto- 
matically alter the electronic data based on predetermined 
parameters when it is determined that an appropriate 
amount of idle time exists. 
[0026] The processor 200 can also include a third processor 74 
that alters the electronic data after the data has been pro- 
cessed by the first processor 72, but prior to the elec- 
tronic data being sent to the network or the output termi- 
nal. The third processor 74 can perform, for example. Im- 
age Output Terminal (lOT) processing for printing or file 
formatting for exporting the electronic data to another 
system. 

[0027] Although the controller 90 in the processor 200 in Fig. 4 
can be a single processor, the processor 200 can also be 
configured to include the first controller 92 discussed 
above, a second controller 93 and a third controller 94. As 
shown in Fig. 4, the first controller 92 controls the first 



processor 72 to process the electronic data during tlie idle 
time to alter the structure of the electronic data or to per- 
form any number of tasks. In various exemplary embodi- 
ments, the determination of whether an adequate idle 
time exists by the first controller 92 can be based on an 
estimation of a duration of idle time available and a com- 
parison the estimation to a predetermined idle time value 
predetermined and preset by a user. 
[0028] The second controller 93 can control the second proces- 
sor 73 to process the electronic data so that the data in- 
cludes the basic image processing functions and any re- 
quired compression via the compression circuit 303. The 
third controller 94 can control the third processor 74 to 
alter the electronic data just prior to the electronic data 
being transmitted to the network or the output terminal 
60. 

[0029] Fig. 5 is an exemplary flowchart of a method of process- 
ing used by the multifunctional device in accordance with 
the invention. After control starts in step 1000, control 
shifts to step 1005 where data, such as an image or ob- 
ject, is input into the multifunctional device by the input 
terminal. The data can be input using input terminals such 
as a personal computer, remote computer or a network. 



Control then shifts to step 1010 where the second con- 
troller controls the electronic data to be processed by the 
second processor, and converted to electronic data. At 
step 1010, the second controller can also control the sec- 
ond processor and the alteration circuit to alter the elec- 
tronic data using the minimum requirements discussed 
above. Next, control shifts to step 1015 where the elec- 
tronic data is stored in the memory. 
[0030] Control then shifts to step 1020. In step 1020, it is deter- 
mined by the controller whether idle time exists prior to 
the electronic data being transmitted to another destina- 
tion. This determination can be based on an estimation of 
available idle time as discussed above. If it is determined 
in step 1020 that idle time exists, control shifts to step 
1030 where it is further determined whether the elec- 
tronic data requires further processing to alter the elec- 
tronic data. If it determined that the data requires alter- 
ations as discussed above, the electronic data controlled 
by the first controller to be processed by the first proces- 
sor and altered by the alteration circuit based on the re- 
quirements of the user. However, if it is determined either 
in step 1020 that no idle time exists, or in step 1030 that 
the electronic data does not require alterations or the idle 



time is determined to be insufficient, then control sliifts to 
step 1025. 

[0031] In step 1025, control determines whether the electronic 
data requires post-processing by the third processor and 
the alteration circuit. If it is determined that the electronic 
data requires post-processing, then control shifts to step 
1045 where the electronic data is controlled by the third 
controller to be processed by the third processor and al- 
tered by the alteration circuit. However, if it is determined 
that the data does not require post-processing, then con- 
trol shifts to step 1040. 

[0032] In step 1040, it is determined whether the electronic data 
will be outputted, for example, to an output terminal or a 
network. If it is determined at step 1040 that the elec- 
tronic data will not be outputted, then control returns to 
step 1015 where the electronic data is stored in the mem- 
ory. If it is determined that the electronic data will be out- 
putted, then control shifts to step 1050 where the elec- 
tronic data is outputted from the multifunctional device. 
Control then stops at step 1055. 

[0033] The additional processing described in the invention is 
only optional processing. The minimal required process- 
ing is done as a normal operation leading to the machine 



design and specifications, and satisfying tlie basic user 
expectations. If idle time exists, and only then, is "not re- 
quested" processing performed as (a) a "guess" to what 
the user might want at a later time; (b) as efficiency en- 
hancer for future applications (better compression, e.g. 
that has an application for remote connection ); (c) as an 
added service that is offered to the user as "bonus". In all 
cases, if the idle time goes away, or if the process does 
not finish during idle time, no harm is done to the actual 
task, since these processes are optional and non- 
destructive (i.e., the summary page just does not exist, 
only half of the words are OCR'd, etc). In this case, either 
the original data is sent, or optionally the original data 
and part of the enhanced services are sent. 
[0034] While the invention has been described in conjunction 

with exemplary embodiment, these embodiments should 
be viewed as illustrative, not limiting. For example, the 
multifunction device may be replaced by a dynamic con- 
figuration of imaging devices, and associated hardware 
and software resources. Various other modifications, sub- 
stitutes, or the like are possible within the spirit and 
scope of the invention. 



